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(54) Appliance and method for communicating and viewing multiple captured images 



(57) An appliance (22) is provided for capturing and 
communicating images to other devices with communi- 
cation capabilities. The capturing and viewing appliance 
(22) includes a processor for manipulating and viewing 
the images on a built-in display (24). Program code 
stored in internal memory includes a thumbnail page 
view application program which allows the user to use 
navigation buttons (42, 44, 46, 48) to view multiple 
images in groups as well as singularly. According to 
another aspect of the invention, the thumbnail image 
navigation interface provides a user-friendly interface 
for effective communication of functionality of an appli- 
ance (22) or other device to the user through use of ani- 
mated transitions. Through the use of icons, navigation 
buttons (42, 44 f 46, 48) and animated transitions used 
to communicate functionality to the user, the present 
invention presents a novel user interface which makes 
the thumbnail image navigation user interface and 
method a solution in devices with limited resources 
which need to be able to navigate among multiple 
images arranged in different orientations. The thumb- 
nail navigation appliance (22) and method is designed 
for navigating among multiple captured images through 



instrument reuse which is especially useful in portable 
hand-held appliances or other devices which are capa- 
ble of displaying images where space and compactness 
are a concern. 



FIG. 1A 
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Description 

BACKGROUND OF THE INVENTION 

FIELD OF THE INVENTION 5 

[0001] The present invention generally relates to the 
field of digital capturing and, more particularly, relates to 
a user interface for a portable hand-held capturing 
appliance for capturing and viewing images through dig- 10 
ital scanning or other means of capturing and communi- 
cating those images to other devices. 

RELATED ART 

15 

[0002] Intangible information is a vital business asset 
that can be exploited for competitive advantage if man- 
aged properly. In the past fifteen years, improvements in 
information processing have been achieved primarily 
from the widespread use of microcomputers in the 20 
workplace and their application in local and wide area 
networks. Through such applications as electronic mail 
(email) and networked access to document storage 
servers, the electronic communications market has 
exploded. Nevertheless, business is still far from reach- 25 
ing a "paperless" workplace. For example, according to 
a 1993 report by BIS Strategic Decisions (hereinafter 
BIS), an information technology consulting firm, more 
than 90 billion documents were created in 1992 and 
more than 1 trillion copies of those documents were 30 
made. Moreover, BIS estimated that printing and copy- 
ing expenses average between 6% and 1 3% of a typical 
company's revenue. These statistics illustrate the eco- 
nomic savings available for those businesses that are 
able to merge paper and technology in a unified infor- 35 
mation processing strategy. 

[0003] One tool that has proven useful for translating 
between paper and electronic information is the digital 
scanner. Scanner- enabled document distribution 
endows paper-based documents with the speed and 40 
convenience of electronic communications. A desktop 
scanner or network scanner allows business profes- 
sionals to scan paper-based documents, manage them 
effectively and distribute them in a timely fashion. Users 
can share and distribute information easily by scanning 45 
directly to their email or PC fax applications. The grow- 
ing popularity of fax modems and email is driving the 
acceptance of scanner-enabled document distribution 
in offices of all sizes. Fax/modem capabilities, which are 
available with virtually ail modem PCs, enable users to so 
send and receive faxes directly from a computer— at 
their desk or while traveling— and to check email 
remotely. 

[0004] Nevertheless, while scanners are ideal for 
users who need to disseminate paper-based informa- 55 
tion to colleagues through PC facsimile and/or email, 
traditional flatbed scanners lack the convenience and 
flexibility that users have become accustomed to 



through such products as notebook computers and cel- 
lular phones. Hand-held scanners are an improvement 
in this regard; however, they are typically dependent on 
a host computer for displaying the scanned images and 
for providing power. U. S. Patent No. 5,550,938 to Hay- 
akawa et af. (hereinafter Hayakawa) discloses a porta- 
ble image scanner designed to overcome these 
disadvantages. Specifically, Hayakawa discloses a 
hand-held cordless image scanner having a dis- 
play/control screen, a memory for storing scanned 
images, a self contained power supply and an interface 
that allows the scanner to be received by a host compu- 
ter as a memory card for transferring stored images 
from the scanner to the computer. While Hayakawas 
scanner is effective in breaking the dependency on a 
host computer for image display and power, it still has 
several drawbacks. For example, Hayakawa's scanner 
offers no image processing features other than the 
capabilities of storing or discarding a newly scanned 
image and reviewing those images that have been 
stored previously. More advanced image processing 
would necessarily be done after transfer to a host com- 
puter. Moreover, Hayakawa does not offer a graphical 
user interface (GUI) containing icons and/or animations 
to assist users in operating their device. Finally, transfer 
of images is limited to those devices having ports for 
receiving an external memory card or the capability of 
reading the scanner memory through a memory card 
drive. 

[0005] Accordingly, a heretofore unaddressed need 
exists in the industry for providing a hand-held image 
capturing appliance and method that allows users to 
navigate among multiple captured images, as well as 
functional menus in the appliance before transfer, and 
the ability to communicate directly with some other unit 
such as a computer, printer, or facsimile machine. In 
addition, the capturing device should provide cordless 
operation and use a standard interface for transferring 
images to other devices. A GUI is preferred to assist 
users, particularly novices, in operating the device. 

SUMMARY QF T HE INVENTION 

[0006] The present invention overcomes the inade- 
quacies and deficiencies of the prior art as discussed 
hereinbefore. The present invention provides an image 
capturing appliance incorporating a menu/image navi- 
gation interface for communicating with and allowing the 
user to view captured images on the appliance and 
communicate those captured images to other devices. 
Specifically, the thumbnail navigation interface and 
method operates in conjunction with the menu/image 
navigation interface and method to provide navigation 
among multiple images. These interfaces facilitate ease 
of use and hardware simplification and miniaturization 
of the capturing appliance for seamless integration of 
the appliance into a consumer's existing tools and proc- 
esses. 
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[0007] The capturing appliance contains a capturing 
means such as photocells and a storage means for stor- 
ing captured images. A processing means is also pro- 
vided for processing the acquired image and displaying 
it on a self-contained display of the appliance. Program 5 
instructions are provided in the memory of the appli- 
ance and allows the user to view multiple captured 
images in a thumbnail size with the option to view 
selected areas of the image in a variety of pixel resolu- 
tions on the display of the appliance. 10 
[0008] The thumbnail navigation interface and method 
provides a user interface incorporating on-screen icons 
and directional navigation buttons for designating cap- 
tured images to be viewed. Animated transitions are 
also included to communicate navigation among multi- 15 
pie captured images to the user. 
[0009] The thumbnail navigation interface and method 
of the present invention have many advantages, a few of 
which are delineated hereafter, as examples. 
[001 0] An advantage of the thumbnail navigation inter- 20 
face and method of the present invention is that they 
provide a simple procedure for navigating among multi- 
ple captured images on an appliance using functional 
buttons. 

[001 1 ] Another advantage of the thumbnail navigation 25 
interface and method of the present invention is that 
they provide a more flexible and user friendly procedure 
for inspecting multiple captured images on an appli- 
ance. 

[001 2] Another advantage of the thumbnail navigation 30 
interface and method of the present invention is that 
they provide a novel way of communicating functionality 
to the user through the use of animation. 
[001 3] Another advantage of the thumbnail navigation 
interface and method of the present invention is that 35 
they provide for a procedure for navigating among 
images in an appliance which is simple, easy to learn 
and efficient. 

[0014] Another advantage of the thumbnail navigation 
interface and method of the present invention is that 40 
they can be employed in virtually any graphical user 
interface (GUI). 

[0015] Other features and advantages of the present 
invention will become apparent to one with skill in the art 
upon examination of the following drawings and detailed 45 
description. It is intended that all such additional fea- 
tures and advantages be included herein within the 
scope of the present invention, as is defined by the 
claims. 

50 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 6] In the accompanying drawings : 

FIG. 1 A is an elevation view of the hand-held image 55 
capture and communication appliance according to 
the present invention, which depicts a side of the 
unit containing the display screen, operation but- 



tons, and navigation buttons; 
FIG. 1 B is an elevation view of the appliance of FIG. 
1 A depicting the opposing side to that illustrated in 
FIG. 1 A, which contains the capture button for per- 
forming an image scan; 

FIG. 1C is an elevation view of the appliance of 
FIGS. 1 A and 1 B depicting an end of the unit, which 
contains the power button; 
FIG. 1D is an elevation view of the appliance of 
FIGS. 1 A, 1 B, and 1 C depicting the opposing end to 
that illustrated in FIG. 1C, which contains a bright- 
ness button for adjusting the visual clarity of the dis- 
play screen; 

FIG. 2 is a high-level block diagram of the internal 
hardware and software architecture of the appli- 
ance illustrated in FIGS. 1 A-1 D; 
FIG. 3 is a high-level state diagram of the applica- 
tion software of FIG. 2; 

FIG. 4 depicts a memory usage indicator on the dis- 
play screen of FIG. 1 A that provide a memory utili- 
zation report for the appliance indicating no images 
are in memory; 

FIG. 5 illustrates a thumbnail view of an imperfectly 
captured image on the display screen of FIG. 1 A; 
FIG. 6 illustrates a thumbnail view of an image suc- 
cessfully captured and displayed with the license 
plate at the bottom on the display screen of FIG. 
1A; 

FIG. 7A illustrates the thumbnail view of FIG. 6 
which has been grouped as displayed on the dis- 
play screen of FIG. 1 A, together with a metaphori- 
cal icon with directional arrows; 
FIG. 7B illustrates the thumbnail view and meta- 
phorical icon of FIG. 7A on the display screen of 
FIG. 1A, where the metaphorical icon has been 
moved across the thumbnail image; 
FIG. 7C illustrates the magnified area designated 
by the metaphorical icon of the thumbnail view of 
FIG. 7B as displayed on the display screen of FIG. 
1A. 

FIGS. 8A and 8B illustrate the tools menus dis- 
played on the display screen of FIG. 1 A; 
FIG. 9A illustrates the first image of an attached 
group of captured images together with naviga- 
tional arrow descriptors as displayed on the display 
screen of FIG. 1A; 

FIG. 9B illustrates an image within an attached 
group of captured images together with naviga- 
tional arrow descriptors as displayed on the display 
screen of FIG. 1A; 

FIG. 9C illustrates the last image of an attached 
group of captured images together with naviga- 
tional arrow descriptors as displayed on the display 
screen of FIG. 1A; 

FIG. 10 illustrates a progress box giving the status 
of image processing as displayed on the display 
screen of FIG. 1A; 

FIG. 1 1 illustrates a thumbnail view of a captured 
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image on the display screen of FIG. 1 A after image 
processing as depicted in FIG. 10; 
FIGS. 12 depicts a memory usage indicator on the 
display screen of FIG. 1A that provides a status 
report of memory utilization for the appliance; and s 
FIGS. 13A t 13B, and 13C are flowcharts describing 
the architecture and operation of the thumbnail 
page view software module of FIG. 2. 

DETAILED DESCRIPTION QF T HE PREFERRED 10 
EMBODIMENT 

[00171 Reference is now made to the drawings 
wherein like reference numerals designate correspond- 
ing parts, throughout these several figures. It should be is 
understood by those skilled in the art that some aspects 
of the present invention may be practiced on any appa- 
ratus for the purposes of viewing multiple images, not 
limited to apparatuses which include or do not include 
image capturing capabilities through a photoelement 20 
array or scanning. For example, a user may use the 
thumbnail navigation interface present invention for 
viewing multiple images or pages on different types of 
computers and networks, such as the Internet. 

25 

Archite ctur e of the ima ge Cap ture and Communica ti on 
Appliance 

[001 8] A portable, hand-held, image capture and com- 
munication appliance 22 embodying the principles of 30 
the present invention is shown in FIGS. 1A through 1D. 
Specifically, FIG. 1 A depicts one side (/.e, front) of appli- 
ance 22, where a flat-panel display 24 along with user 
operation buttons 26, 28, 32, 34, 36, 38 and user navi- 
gation buttons 42, 44, 46, 48 are located. Display 24 is 35 
preferably of the flat-panel variety to accommodate the 
hand size dimensions of appliance 22. Common types 
of flat-panel displays suitable for use in the present 
invention include electroluminescent displays, gas 
plasma discharge displays, liquid crystal displays 40 
(LCDs) and field emission displays (FEDs). Display 24 
is the means by which information, including captured 
images, text, icons, and animations, is communicated to 
the user. The user operation buttons comprise an image 
send or transmit button 26, an image zoom button 28, 45 
an image rotate button 32, an image delete button 34, a 
help utility button 36 and a tools menu button 38. Send, 
zoom, rotate, and delete buttons 26, 28, 32 and 34 allow 
the user to electronically manipulate an image or page 
that has been scanned into memory through photoele- 50 
ment array 52. Activation of tools button 38 presents the 
user with a menu that includes possible image opera- 
tions (e.g., image attachment/grouping, image detach- 
ment/ungrouping), changing the mode of appliance 22 
(i.e., toggling between text (binary) capture and image 55 
(grayscale) capture), calibrating appliance 22, display- 
ing a screen identifying important specifications such as 
a model number, hardware or software release number, 



memory usage, selecting a page size for printing, etc. , 
or other user utilities not deserving of a dedicated exter- 
nal button for activation. Help button 36 provides the 
user with access to both general tutorials, process ani- 
mation, and how-to instructions on the operation of 
appliance 22 and context sensitive instruction when 
requested while another operation or menu is active. 
The navigation buttons include an up button 42, a down 
button 44, a left button 46, and a right button 48 and are 
controlled by the user to steer a course through menu 
items and to view images or pages that have been cap- 
tured in memory. 

[0019] FIG. 1 B shows the side of appliance 22 oppo- 
site that illustrated in FIG. 1 A (i.e., back). The back side 
of appliance 22 includes image capture button 54, 
which is depressed by a user to scan an image through 
photoelement array 52 and is released once the image 
is captured. A power switch 56 is included at one end of 
appliance 22 as shown in FIG. 1C and a contrast control 
58 for display 24 is located at the other end of appliance 
22 as shown in FIG. 1D. The positioning of the various 
buttons, power switch 56 and contrast control 58 on 
appliance 22 as shown in FIGS. 1A through 1D is 
merely exemplary and can be modified as needed to 
satisfy the ergonomic requirements of the targeted user 
community. 

[0020] Referring now to FIG. 2, the internal architec- 
ture of appliance 22 will be described hereafter. Appli- 
ance 22 includes a processor 62, which communicates 
with a memory 64 via address/data bus 66. Processor 
62 can be any commercially available or custom micro- 
processor suitable for an embedded application. Mem- 
ory 64 is representative of the overall hierarchy of 
memory devices containing the software and data used 
to implement the functionality of appliance 22. Memory 
64 can include, but is not limited to, the following types 
of devices: cache, ROM, PROM, EPROM, EEPROM, 
flash, SRAM, and DRAM. As shown in FIG. 2, memory 
64 holds four major categories of software and data 
used in appliance 22: the operating system 68; the 
application software 70; the I/O device drivers 72; and 
the image data 74 generated for each scan. Operating 
system 68 should be designed for real time embedded 
applications and, preferably, is relatively compact to 
make the most efficient use of memory 64. One such 
example of a real time operating system meeting these 
criteria is the PSOSYSTEM operating system (pSOSys- 
tem® or pSOS®) sold by Integrated Systems, Inc., 
Santa Clara, California, U.S.A., which is used in the pre- 
ferred embodiment of the present invention. I/O device 
drivers 72 include software routines accessed through 
operating system 66 by application software 70 to com- 
municate with devices such as display 24, certain mem- 
ory components 64 and I/O ports such as a serial port 
or infra red (IR) port for transferring data to another 
appliance, device or system. The digital representations 
of the images captured by appliance 22 is denoted by 
image data 74. The format used for storing the images 
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should be compatible with application software 70. One 
common format used for encoding images is the JPEG 
standard; however, other public or proprietary standards 
can be used with equal success. In the preferred 
embodiment, CCITT-G4, which is designed for facsimile 5 
usage and black and white images, is used. Finally, 
application software 70 comprises the control programs 
that implement the various features of appliance 22. 
Application software 70 and devices drivers 72 are typi- 
cally written in a high-level programming language such w 
as C or C++ for development convenience. Neverthe- 
less, some drivers or application modules are some- 
times written in assembly or machine language to 
optimize speed, memory usage or layout of the software 
in memory. In the preferred embodiment, the present 15 
invention uses C language to implement most applica- 
tion software 70 and device drivers 72 and assembly 
language for the most time-critical sections. 
[0021 ] Application software 70 can be broken into sev- 
eral modules corresponding to the various features of 20 
appliance 22, as shown in FIG. 2. These software mod- 
ules include an initialization module 76, a capture page 
module 78, a thumbnail view module 82, a zoom view 
module 84, a page rotation module 86, an attach page 
module 88, a detach page module 92, a delete page 25 
module 94, a send page module 96, an error utility mod- 
ule 98, a help utility module 102 and a menu/navigation 
interface module 104. Note that an image captured in 
memory is interchangeably referred to herein as a 
"page" because the image is portrayed in appliance 22 30 
as a physical page of text and/or imagery. A brief over- 
view of each of the aforementioned modules follows 
hereafter. 

[0022] Initialization module 76 contains the boot soft- 
ware that is invoked when appliance 22 powers up. This 35 
module works closely with operating system 68 and 
device drivers 72 to perform any hardware initialization 
for processor 62, memory devices 64, display 24, and 
software initialization for global resources, such as mes- 
sage queues and buffers, system tasks, and memory 40 
partitions. Capture page module 78 controls the acqui- 
sition of images through photoelement array 52 and 
their conversion into a suitable format for storage in 
memory 64. Thumbnail view module 82 provides the 
default visual for pages and icons shown on display 24. 45 
The thumbnail view presents an entire page on display 
24 as illustrated in FIG. 6. This module shall be dis- 
cussed in more detail hereinafter. Zoom view module 84 
allows the user to magnify a portion of a page as illus- 
trated in FIG. 7C. Page rotation module 86 allows the so 
user to rotate a page either in thumbnail or zoom view in 
90° increments. Attach page module 88 allows the user 
to logically join pages together to form a group of pages 
that can deleted, sent or viewed as an individual unit, 
but not rotated or zoomed. Rotation and zoom always 55 
apply only to the current page. Conversely, detach page 
module 92 allows the user to separate a page or pages 
from a previously formed group. Delete page module 94 



allows the user to purge a page or group of pages from 
memory 64. Send page module 96 allows the user to 
transfer a page or group of pages to another appliance, 
device or system through the serial or IR communica- 
tion ports of appliance 22. Error utility module 98 pro- 
vides notification to the user when the user attempts an 
invalid operation. Help utility module 102 provides the 
user, in real time, with general instructions and anima- 
tions on operating appliance 22 and context sensitive 
instructions for performing a specific operation. Lastly, 
menu/navigation interlace module 104 provides the 
user with graphical menus for performing various oper- 
ations and processes the user's response thereto. 
Moreover, menu/navigation interface module 104 
responds to navigation buttons 42, 44, 46, and 48 that 
allow the user to steer a course through the graphical 
menus and works in conjunction with the thumbnail view 
module 82 to view the stored pages. Portions of the 
operation of menu/navigation interface module 104 will 
be discussed hereinafter in describing the operation of 
the thumbnail view module 82. 
[0023] A high level state diagram for application soft- 
ware 70 is shown in FIG. 3. This state diagram is useful 
for gaining a broad understanding of the operation of 
application software 70 and its associated software 
modules. These states are representative of tasks or 
processes in application software 70 that act on mes- 
sages from a message queue, which are generated as 
a result of user interaction with appliance 22 (i.e., acti- 
vation of buttons). Appliance 22 and application soft- 
ware 70 begin and terminate from the off state 106, 
which is controlled by the user through operation of 
power switch 56. Off state 1 06 can clearly be entered 
from any other state in response to a user turning appli- 
ance 22 off through switch 56. When a user turns switch 
56 to the on position, the system will pass through a 
transient initialization state 108 during which time initial- 
ization module 76 is invoked to perform its functions. 
Once system initialization is complete, the system 
enters the thumbnail view state 1 1 2, which is the default 
state for viewing any captured images. From thumbnail 
view state 112, the system can transition to any one of 
several possible states depending on the action by the 
user. For example, the capture button can be pressed to 
enter capture state 1 1 4 to perform an image scan. After 
the image is captured, the button is released to return to 
thumbnail view state 1 12. If the user wishes to change 
the orientation of the captured image, then activation of 
rotation button 32 will rotate the captured image 90° 
with each invocation. Moreover, now that an image is 
captured in memory 64, a user can obtain a magnified 
view of a portion of the image or page by pressing zoom 
button 28 to enter zoom view state 116. Similar to 
thumbnail view state 112, the magnified image can also 
be rotated through application of rotation button 32. The 
system will return to thumbnail view state 1 12 through 
operation of zoom button 28 or performing certain 
actions such as capture, send, delete, attach, detach, 
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etc. Additionally, the thumbnail view state 112 includes 
functionality for the empty (no images) state and the 
image verification state. 

[0024] From thumbnail view state 112, one of four 
menu states can be entered depending on the choice s 
made by the user. First, activation of tools button 38 will 
transition the system into tools menu state 1 18 where a 
menu of possible page operations and/or features is 
exhibited on display 24 as illustrated in FIGS. 8A and 
8B. Second, activation of send button 26 will transition 10 
the system into send menu state 122 where a menu of 
options for transferring a page or group of pages to 
another appliance, device or system is exhibited on dis- 
play 24. Third, activation of delete button 34 will transi- 
tion the system into delete menu state 124 where a is 
menu of options for deleting a page or group of pages 
from memory 64 is exhibited on display 24. Lastly, acti- 
vation of help button 36 will transition the system into 
help menu state 126 where a menu of help topics is 
exhibited on display 24. Once any of the aforemen- 20 
tioned menu states is reached, the user can choose a 
desired menu option by using navigation buttons 42 and 
44 and then validating the choice by pressing a confir- 
mation button. Menu states may be exited by simply 
invoking navigation button 46 to transition to a previous 25 
state. 

[0025] From some states, an invalid response by the 
user (i.e., user presses an inactive button) will be 
ignored or will result in a transition to the default mes- 
sage handler state 128 where the user response is 30 
interpreted through the message that was generated 
internally and a transition is made to the error dialog 
state 132 to notify the user of their error via a message 
or graphic on display 24. Inactive buttons will occasion- 
ally also display a blinking icon to communicate to the 35 
user the selection of the inactive button and which but- 
tons are active. Alternatively, error dialog state 132 can 
be entered directly if application software 70 detects an 
error in the execution of a valid operation. The most 
common example of this is when the user follows an 40 
improper capture path with appliance 22 during the 
image capture process. 

[0026] The features provided by the thumbnail page 
view software module 82 will be described hereafter 
with frequent reference to (a) the architecture and oper- 45 
ation of the application software 70 of FIG. 2; (b) the 
flowcharts of FIG. 13A, FIG. 13B and FIG. 13C; and (c) 
the captured screen illustrations of FIG. 4 through FIG. 
12. 

50 

Operation of the Thumbnail Page View Interface and 
M et ho d 

[0027] Recall from the state diagram of FIG. 3 that 
when power is provided via switch 56 (FIG. 1 C) applica- 55 
tion software 70 passes through a transient initialization 
state 108 to reach thumbnail view state 112, which is 
the default state for capturing images using capture but- 



ton 54 and viewing images. Upon successfully captur- 
ing an image, the image is displayed as a thumbnail size 
icon as illustrated in FIG. 6 on the display 24 (FIG. 1 A), 
together with a descriptor, also referred to as a license 
plate, which communicates the location which the 
image holds in memory with respect to other saved 
images. Directional arrows are also included on the 
license plate to communicate to the user which naviga- 
tional buttons may be used to navigate among the 
images in memory. In the preferred embodiment, the 
thumbnail size image is scaled to 1/24 the size of the 
original image and displayed on the display screen, 
however, it should be understood that any size reduction 
may be used while still obtaining with the spirit of the 
invention. This reduction in size affords the user an aer- 
ial view of the image as it appears in memory to verify a 
successful capture of the image. In some instances, a 
user may incorrectly use the appliance and not acquire 
the entire image as depicted in FIG. 5. The thumbnail 
view allows the user to easily recognize that the entire 
image was not captured and the process may need to 
be repeated without having to execute a close inspec- 
tion. Once a user successfully captures and verifies an 
image (FIG. 6), a user may then closely inspect the 
image by zooming into a specific area of the thumbnail 
image using a metaphoric icon and increasing the area 
designated to a higher pixel resolution, depicted by FIG 
7A though 7C. 

[0028] From the thumbnail view state, the appliance 
may reach various other states, i.e. TOOLS MENU 118, 
SEND MENU 122, DELETE MENU 124, HELP MENU 
126 where users interact with a menu or message box 
to operate the appliance in that state. ERROR DIALOG 
messages can be entered from any state. In all of the 
aforementioned states, the navigation buttons serve 
functions in conjunction with other operational buttons 
to enable the user to operate the appliance. In particu- 
lar, a user may enter the TOOLS MENU state by 
depressing the tools button 38 (FIG. 1A). In this state 
the Tools Menu is displayed as depicted in FIG. 8A and 
8B, depending on whether or not the user is examining 
a grouped thumbnail. Specifically, this menu allows the 
user to attach and detach images with respect to groups 
as displayed in FIG 9A through 9C. 
[0029] FIG. 13A, FIG. 13B and FIG. 13C are func- 
tional flowcharts detailing the operation of the naviga- 
tion buttons within the thumbnail page view interface 
and method. In FIG. 13A, after initialization of the appli- 
ance at power up, logic determines whether a single 
(ungrouped) thumbnail image (FIG. 6) or a memory 
usage indicator (FIG- 12) is being displayed 164, or a 
grouped thumbnail image (FIG. 9A through FIG. 9C) is 
being displayed 1 74. If it is determined that the user is 
viewing neither, then the empty memory usage indicator 
is displayed informing the user that no pages are in 
memory (FIG. 4) 178. In that ease, all of the navigation 
buttons 42, 44, 46, 48 (FIG. 1 A) and the send 26, zoom 
28, rotate 32 and delete 34 buttons (FIG. 1 A) will cause 
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a message to be displayed describing how the user is to 
begin an image capture 178. In the preferred embodi- 
ment, if a single thumbnail image is displayed, the left 
and right navigation buttons 46, 48 (FIG. 1A) will slide 
the image off the screen to the left or right 1 66. It should 
be understood that the up and down navigation buttons 
42, 44 (FIG. 1A) could optionally be used to slide the 
image off the screen up or down. However, in the pre- 
ferred embodiment, the up and down navigation buttons 
42, 44 (FIG. 1A) will blink a live arrow button icon 166 
located on the license plate as can be seen at the bot- 
tom of the screen in FIG. 6. When the left or right navi- 
gation buttons 46, 48 (FIG. 1A) are depressed, the 
license plate number is incremented or decremented 
indicating that the next or previous page or group in 
memory is being displayed 168. If another image is not 
stored at the next or previous memory location, a status 
memory usage indicator will be displayed informing the 
user of the number of pages stored and the amount of 
memory used and/or remaining (FIG. 12). If a group 
thumbnail image is being displayed 174, a determina- 
tion of whether the displayed image is the first image in 
the group (FIG. 9A), the last image (FIG. 9C) in the 
group or an image within the group (FIG. 9B) is made. 
[0030] In FIG. 1 3B, a determination of whether the dis- 
played image is the first image (FIG. 9A) in the group 
184, the last image (FIG. 9C) in the group 194 or an 
image within (FIG. 9B) the group 198 is made. If the 
group image displayed is the first image (FIG. 9A) 184, 
the left and right navigation buttons 46, 48 (FIG. 1A) 
slide the group image off the screen to display the next 
(FIG. 1 1) or previous page or group (FIG. 6) or memory 
usage indicator (FIG. 12) in memory which is not in the 
group 186. The down navigation button 44 (FIG. 1A) 
displays the next image in the group 186. In the pre- 
ferred embodiment, Hipping" animation is used to com- 
municate to the user that the page flipped and the page 
displayed are within the same group. The up navigation 
button 42 (FIG. 1 A) blinks a live arrow button icon. Sim- 
ilarly, if the last image (FIG. 9C) in the group is displayed 
194, the up navigation button 42 (FIG. 1A) displays the 
previous image in the group (FIG. 9B) with the down 
navigation button 44 (FIG. 1 A) blinking a live arrow but- 
ton icon 196. If the image displayed is a page within a 
group 198, the functionality of all navigation buttons 42, 
44, 46, 48 (FIG. 1A) are activated giving the user the 
ability to navigate the thumbnail images within the 
group. In all instances, additional logic is executed to 
display momentary icons to the user to communicate 
functionality. 

[0031] In FIG. 13C, logic checks to see if an attach or 
detach function (FIG. 8 A and FIG. 8B) has been exe- 
cuted which will affect the number of images in the 
group 214. If an attach or detach command has been 
executed, the attach or detach animation is displayed, 
then a page-of-group number icon is momentarily dis- 
played with the group and page number within this icon 
being incremented or decremented 216. If an image flip 



has been executed by using the up or down navigation 
buttons 234, the page flip animation is displayed, then a 
page-of-group number icon is momentarily displayed 
with the page number incremented or decremented 

5 236. Finally, if the left or right navigation button 46, 48 
(FIG. 1 A) is depressed 244, animation is displayed of 
pages flipping back to the first page of the group and the 
opened group is automatically closed 246. The license 
plate number is then incremented or decremented 246 

10 and the next or previous image not in the group is dis- 
played. It is important to note that during navigation 
within a group, the license plate number is not incre- 
mented or decremented, but is only done so when nav- 
igating out of the group. This commununicates that the 

15 images viewed are within a group, and are logically con- 
nected in some way. 

[0032] With reference to the present invention com- 
municating to the user the current location in memory, in 
an alternate embodiment of the present invention, the 

20 user may be displayed a two dimensional grid naviga- 
tional window which shows the user the current image 
displayed with respect to all other images stored contig- 
uously in memory. This function allows the user to 
instantly view any image stored in memory. 

25 [0033] The thumbnail page view program 82 of the 
present invention can be implemented in hardware, 
software, firmware, or a combination thereof. In the pre- 
ferred embodiment(s), the thumbnail page view pro- 
gram 82 is implemented in software or firmware tat is 

30 stored in a memory 64 and that is executed by a suitable 
instruction execution system. 
[0034] The thumbnail page view program 82, which 
comprises an ordered listing of executable instructions 
for implementing logical functions, can be embodied in 

35 any computer-readable medium for use by or in connec- 
tion with an instruction execution system, apparatus, or 
device, such as a computer-based system, processor- 
containing system, or other system that can fetch the 
instructions from the instruction execution system, 

40 apparatus, or device and execute the instructions. In the 
context of this document, a "computer-readable 
medium" can be any means that can contain, store, 
communicate, propagate, or transport the program for 
use by or in connection with the instruction execution 

45 system, apparatus, or device. The computer readable 
medium can be, for example but not limited to, an elec- 
tronic, magnetic, optical, electromagnetic, infrared, or 
semiconductor system, apparatus, device, or propaga- 
tion medium. More specific examples (a nonexhaustive 

50 list) of the computer-readable medium would include 
the following: an electrical connection (electronic) hav- 
ing one or more wires, a portable computer diskette 
(magnetic), a random access memory (RAM) (mag- 
netic), a read-only memory (ROM) (magnetic), an eras- 

55 able programmable read-only memory (EPROM or 
Flash memory) (magnetic), an optical fiber (optical), 
and a portable compact disc read-only memory 
(CD ROM) (optical). Note that the computer-readable 
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medium coutd even be paper or another suitable 
medium upon which the program is printed, as the pro- 
gram can be electronically captured, via for instance 
optical scanning of the paper or other medium, then 
compiled, interpreted or otherwise processed in a suita- 5 
ble manner if necessary, and then stored in a computer 
memory 64. 

[0035] In concluding the detailed description, it should 
be noted that it will be obvious to those skilled in the art 
that many variations and modifications can be made to 10 
the preferred embodiment without substantially depart- 
ing from the principles of the present invention. All such 
variations and modifications are intended to be included 
herein within the scope of the present invention, as set 
forth in the following claims. is 



a photoelement array for acquiring image data 
(74); 

a memory (64) for saving said image data (74); 
a processor (62) in communication with said 
memory (64); 

a display in communication with said processor 
(62) for exhibiting said image data (74); and 
program code (70) stored in said memory (64) 
and executed by said processor (62) for view- 
ing said image data (74), said program code 
(70) comprising a page view software module 
for viewing said image data (74) on said display 
of said appliance and an attach page software 
module for grouping a plurality of said image 
data (74) into an image collection. 



Claims 

1. A portable hand-held image capturing appliance 
(22), comprising: 20 



7. The appliance (22) of claim 6, wherein a second 
image data (74) in said sequence of said image 
data (74) grouped in said image collection is dis- 
played on said display (24) upon a user request. 



a photoelement array (52) for acquiring image 
data (74); 

a memory (64) for saving said image data (74); 
a processor (62) in communication with said 25 
memory (64); 

a display (24) in communication with said proc- 
essor (62) for exhibiting said image data (74); 
and 

program code stored in said memory (62) and 30 
executed by said processor (62) for viewing 
said image data (74), said program code (70) 
comprising a page view software module (82) 
for viewing said image data (74) on said display 
(24) of said appliance (22). 35 

2. The appliance (22) of claim 1, wherein said image 
data (74) is sequentially denoted with a label upon 
said acquisition, said label appearing on a license 
plate with said acquired image on said display (24) 40 
of said appliance (22). 

3. The appliance (22) of claim 2, wherein a second 
image data (74) in said sequence is displayed on 
said display (24) upon a user request. 45 

4. The appliance (22) of claim 3, wherein a second 
program code (70) displays an animated sequence 
on said display (24) before displaying said second 
image data (74). so 

5. The appliance (22) of claim 4, wherein said ani- 
mated sequence is said image sliding off the said 
display (24). 

55 

6. A portable hand-held image capturing appliance, 
comprising: 



8. The appliance (22) of claim 7, wherein a second 
program code (70) displays an animated sequence 
on said display (24) before displaying said second 
sequential image (74) of said image collection. 

9. The appliance (22) of claim 7, wherein said image 
collection closes before displaying a second image 
(74) not in said image collection. 

10. The appliance (22) of claim 8, wherein said ani- 
mated sequence is of a page flipping. 



12/8/04, EAST Version: 2.0.1.4 



EP 0 978 987 A2 




12/8/04, EAST Version: 2.0.1.4 



EP 0 978 987 A2 



Capture/Communication Appliance 
22 




Memory 




64 






Operating 




I/O Device 






System 




Drivers 






68 




12 










Application 




Image 






Software 




Data 






Z0 




74 

















FIG. 2 





Application 
Software 
70 








Initialization 
76 




Rotate Page 
86 




Send Page(s) 

96 














Error Utility 
98 






Capture 
Page(s) 
78 




Attach Page(s) 
88 








Help Utility 
102 




Thumbnail 
Page View 
82 




Detach Page(s) 
92 








Menu/ 
Navigation 
Interface 
104 




Zoom Page 
View 
84 




Delete Page(s) 
94 













12/8/04, EAST Version: 2.0.1.4 



EP0 978 987 A2 



rotate 
button 
depressed 




FIG. 3 



12/8/04, 



EAST Version: 2.0.1.4 



EP 0 978 987 A2 



No Pages 
in memory... 



FIG. 4 




FIG. 5 



30 16 l>£ 



F/G. 6 



^7 



V), 



=*=- *5 3 " 3>i 



F/G. 7A 




17.58% ~ 
18.35% - 



19.13% (11/10/97) 
13.43% (11/25/981 j 



ttion kit about transferring or rolling 
our family of no-load mutual funds, 
h more complete information, includ- 
read the prospectus. 



21 



uri 641-6200 




FIG. 7B 



FIG. 7C 



12/8/04, EAST Version: 2.0.1.4 



EP 0 978 987 A2 



Tools 



Attach to Previous 



Set Capture Mode... 

Calibrate... 

About... 



//OK 0 Cancel 

FIG. 8 A 



















































1/13 ) 






=1 i ^ iiiT 






















a* i 










«] 17 [>V— 



F/G. 9A 



























,13/13) 




































IWYfc,*** , Q5H1 






[<1 17 l>J 





F/G. 9C 



Tools 



Detach from Previous 



Set Capture Mode... 

Calibrate... 

About... 



//OK 0 Cancel 

F/G. 8B 



f2a 


























12/13 ) 




























— - « . *. k. 












to 17 i>i 



F/G. 9S 





s 


aving... 








0 Cancel 

^ M 

-—A, 18 1 





F/G. f 0 



12/8/04, EAST Version: 2.0.1.4 



EP 0 978 987 A2 







US? 

SpSSJ 

ip£ 

fifi&gS 














I " ji.-i 






- — (0 18 Dl 





F/6. ff 





25 pages 






■■■HCZZZ3 

62% full 

1 CI l» 





F/G. 72 



12/8/04, EAST Version: 2.0.1.4 



EP 0 978 987 A2 




Yes- 



EMPTY MEMORY 
RESOURCE INDICATOR 
DISPLAYED; ALL NAV. 

BUTTONS AND THE 
SEND, ZOOM, ROTATE 
AND DELETE BUTTONS 
DISPLAY A MESSAGE 
ON HOW TO BEGIN 
CAPTURE 



168 



166 



LEFT AND RIGHT 
NAV. BUTTONS 
SLIDE IMAGE OFF 
SCREEN DISPLAY 
TO NEXT IMAGE 
OR MEMORY 
USAGE 
INDICATOR; UP 
AND DOWN NAV. 
BUTTONS BLINK 
LIVE ARROW 
BUTTON ICON 



IF LEFT/RIGHT 
NAV BUTTON 
DEPRESSED, 
INCREMENT/ 
DECREMENT 
LICENSE PLATE 
NUMBER OR 
REMOVE MEMORY 
USAGE INDICATOR 



FIG. 13A 



12/8/04, EAST version: 2.0.1.4 



EP 0 978 987 A2 



PAGE WITHIN GROUP 
DISPLAYED; LEFT AND 
RIGHT NAV. BUTTONS 

DISPLAY GROUP 
CLOSING ANIMATION 
AND SLIDE ENTIRE 
PAGE OR GROUP OFF 
SCREEN TO DISPLAY 

NEXT PAGE OR 
GROUP; UP AND DOWN 
NAV. BUTTONS "FLIP" 
PAGES UP TO DISPLAY 

PAGES IN GROUP 




LEFT AND RIGHT 
NAV. BUTTONS 
SLIDE THE GROUP 
IMAGE OFF 
SCREEN TO 
DISPLAY NEXT OR 
PREVIOUS PAGE 
OR GROUP OR 
MEMORY USAGE 
INDICATOR; DOWN 
NAV. BUTTON 
DISPLAYS NEXT 
PAGE IN GROUP; 
UP NAV. BUTTON 

BLINKS LIVE 
ARROW BUTTON 
ICON 



T 
B 




LEFT AND RIGHT 
NAV. BUTTONS 
SLIDE GROUP 
PAGE OFF 
SCREEN TO 
DISPLAY NEXT OR 
PREVIOUS PAGE 
OR GROUP OR 
MEMORY USAGE 
INDICATOR; UP 
NAV. BUTTON 
DISPLAYS 
PREVIOUS PAGE 
IN GROUP; DOWN 
NAV. BUTTON 
BLINKS LIVE 
ARROW BUTTON 
ICON 



B 



FIG. 13B 



12/8/04, EAST Version: 2.0.1.4 



EP 0 978 987 A2 




Yes- 



DISPLAY ATTACH 

OR DETACH 
ANIMATION, THEN 
MOMENTARILY 
DISPLAY PAGE- 
OF-GROUP 
NUMBER; 
INCREMENT/ 
DECREMENT 
GROUP AND PAGE 
NUMBER; 



216 



Yes 



236 



DISPLAY PAGE 
FLIP ANIMATION, 

THEN 
MOMENTARILY 
DISPLAY PAGE- 
OF-GROUP 
NUMBER; 
INCREMENT/ 
DECREMENT 
PAGE NUMBER; 



A r 



246 



DISPLAY ANIMATION FLIP TO FIRST 
PAGE OF GROUP; SLIDE ENTIRE 
GROUP OFF SCREEN TO DISPLAY 

NEXT PAGE OR GROUP OR 
MEMORY RESOURCE INDICATOR; 
INCREMENT/DECREMENT LICENSE 
PLATE NUMBER 



T 
C 



FIG. 13C 



12/8/04, EAST Version: 2.0.1.4 



